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Abstract 

The  separation  of  vectors  by  multigrid  (MG)  algorithms  is  applied  to  the  study  of 
convergence  and  to  the  prediction  of  the  performance  of  MG  algorithms.  The  separation 
operator  for  a  two  level  cycle  algorithm  is  derived.  It  is  used  to  analyze  the  efficiency  of  the 
cycle  when  mixing  of  eigenvectors  occurs.  In  particular  cases  the  separation  analysis  reduces 
to  Fourier  type  analysis.  The  separation  operator  of  a  two  level  cycle  for  a  Schrodinger 
eigenvalue  problem,  is  derived  and  analyzed  in  a  Fourier  basis.  Separation  analysis  gives 
information  on  how  to  chose  relaxations  and  inter-level  transfers.  Separation  analysis  is  a 
tool  for  analyzing  and  designing  algorithms,  and  for  optimizing  their  performance. 
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1  Introduction 


The  efficiency  of  multigrid  (MG)  techniques  in  solving  large  scale  eigenvalue  problems  de¬ 
rived  from  discretizations  of  partial  differential  eigenvalue  problems,  was  shown  in  multiple 
works,  for  example  in  [1]  [3]  [13]  [16]  [18]  [20]  [21]  [27]. 

This  work  is  motivated  by  the  need  of  tools  of  analyzing,  and  designing  robust  and 
efficient  MG  eigenvalue  solvers.  These  tools  were  needed  for  the  algorithms  presented  in 
[4],  [5]  [6]  [19]  [24]  and  in  the  reports  [7]  [8]  [9]  [10].  The  algorithms  were  applied  to  elec¬ 
tromagnetism  and  Schrodinger  eigenvalue  problems  in  2D  and  3D.  Their  efficiency  resides 
in  their  eigenvector  separation  effectiveness,  i.e.,  in  how  well  they  separate  the  subspace  of 
desired  eigenvectors  from  the  remaining  eigenvectors  and  how  well  they  separate  the  eigen¬ 
vectors  inside  this  subspace.  These  naturally  hint  to  analyze  how  a  procedure  separates 
given  eigenvectors,  i.e.,  how  it  acts  on  the  amplitudes  of  the  eigenvectors,  or  more  generally 
on  the  amplitudes  of  a  basis  of  vectors.  The  action  of  an  algorithm  on  the  amplitudes  of 
the  vectors  of  a  basis  is  called  the  separation  operator.  Separation  factors,  showing  the 
amplification  of  one  vector  with  respect  to  another  one,  can  be  used  to  define  and  analyze 
different  convergence  rates.  In  particular  cases,  Fourier  analysis  can  be  used  to  compute 
separation  factors.  Separation  analysis  does  not  reduce  to  convergence  analysis  only;  for 
example,  one  may  have  divergence  of  relaxations  but  good  separation,  and  separation  de¬ 
termines  the  efficiency  of  the  algorithm.  Convergence  results  are  obtained,  which  can  be 
applied  directly  to  show  the  convergence  of  single  level  or  multilevel  algorithms.  The  results 
are  used  for  the  analysis  of  a  two  level  separation  operator  which  defines  the  action  of  a 
two  level  algorithm  on  the  amplitudes  of  given  vectors.  For  eigenvalue  problems,  a  major 
issue  is  the  “mixing”  of  eigenvectors  due  to  inter-level  transfers.  It  is  shown  that  better 
convergence  is  obtained  if  the  mixing  is  small  or  when  all  eigenvectors  which  get  mixed  are 
treated  together,  e.g.,  in  case  of  clusters. 

An  example  of  separation  analysis  which  reduces  to  a  Fourier  type  analysis  of  the  two 
level  separation  operator  is  presented.  This  is  used  in  the  design  of  MG  eigenvector  algo¬ 
rithms  and  in  the  prediction  of  their  performance.  For  the  Schrodinger  eigenvalue  problem 
with  periodic  boundary  conditions,  the  analysis  calculates  accurately  the  convergence  fac¬ 
tors.  The  matrix  of  the  separation  operator  can  be  computed  by  a  subroutine  and  the 
efficiency  of  the  algorithm  can  be  optimized  analyzing  the  separation  operator  as  a  func¬ 
tion  of  several  parameters  such  as  relaxation  types,  iteration  numbers. 

For  MG  techniques  and  more  on  MG  eigenvalue  algorithms  we  refer  to  [2]  [3]  [16].  An 
outline  of  general  MG  approaches  related  to  separation  and  MG  optimization  is  presented 
in  [12]  [25].  For  eigenvalue  algorithms  and  theory  on  algebraic  eigenvalue  problems  we  refer 
to  [17]  [2.3]  [26]  [14]. 
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2  The  Separation  Operator,  Separation  Factors  and 
Convergence  Rates 

A  central  goal  is  to  analyze  the  action  of  an  algorithm  on  the  amplitudes  of  given  vectors, 
for  example  on  the  eigenvectors  of  a  given  matrix.  This  action  is  defined  by  the  separation 
operator.  The  separation  operator  can  be  used  in  the  analysis  of  convergence  and  in  the 
optimization  of  the  algorithm. 

2.1  The  Separation  Operator  and  Separation  Factors 

Assume  that  the  n  xn  matrix  U  has  independent  columns  f/i, ...,  Un-  For  example  Ui  may 
be  Fourier  components  or  the  eigenvectors  of  a  given  matrix.  Assume  that  an  algorithm 
transforms  the  vector  UB  into  the  vector  UB,  where  B  and  B  denote  vectors  of  dimension 
n.  Thus  B  and  B  are  the  amplitudes  ofUi,...,Un  before  and  after  the  algorithm  is  applied. 
The  algorithm  defines  a  mapping 

WB  =  B  (2.1) 

W  is  the  mapping  of  the  amplitudes  of  the  vectors  Ui  under  the  action  of  the  algorithm. 
The  mapping  W  will  be  called  the  Separation  Operator.  The  W  may  not  be  linear,  e.g., 
for  MG  algorithms  which  employ  projections.  For  particular  MG  cycles  W  is  linear  and 
will  be  computed  in  next  sections. 

Consider  further  the  case  when  IT  is  an  n  x  n  diagonalizable  matrix  with  normalized 
eigenvectors  corresponding  to  the  eigenvalues  pi, pn-  For  simplicity  assume 

that  \pi\  >  \p2\  >  •••  >  \fJ-n\  >  0,  although  the  further  analysis  can  be  performed  in  a 
similar  way  for  the  general  case  too.  Ei  will  be  called  the  dominant  eigenvector  of  W . 

For  given  vectors  B  =  (6i, ...,  B  =  WB  =  (6i,...,6„)^  define  the  separation 
factor  of  Ui  relative  to  Uj  and  to  B  by 

sp,B  =  {klh)l{hlh,)  (2.2) 

when  this  is  meaningful,  (i.e.,  when  bj  ^  0,  bj  7^  0,  or  define  0  and  00  values  when  only  one 
is  0).  Implicitly,  the  Sij^s  depends  on  W  also. 

It  will  be  said  that  Ui  is  amplified  by  B  if  U  7^  0.  Denote  by  tpm  the  p’th  component  of 
the  eigenvector  Em-  Define  the  asymptotic  separation  factor  of  Ui  relative  to  Uj  by: 

Sij  =  ptlpi  (2.3) 

where  t  =  min{m  :  tim  ^  0}  and  I  =  min{m  :  tjrn  7^  0}.  The  t  and  /  in  the  definition  of 
Sip  show  the  first  (smallest  index)  eigenvectors  Et  and  Ei  which  amplify  Ui.,  respectively 


2 


Uj.  It  will  be  also  said  that  Et  is  the  first  eigenvector  amplifying  Ui.  If  Et  is  the  eigenvector 
amplifying  first  both  Ui  and  Uj  then 

s,,  =  1  (2.4) 

Sij,Et  =  1  (2-5) 

2.2  Convergence  of  the  Iterative  Algorithm 

If  an  algorithm  with  separation  operator  W  is  iteratively  applied  starting  with  then 

the  same  results  can  be  obtained  by  iterating  W  starting  with  Thus  the  iteration  of 
the  algorithm  reduces  to  a  power  iteration  for  IT,  just  in  the  space  of  the  amplitudes.  The 
algorithm  may  be  complicated  but  the  power  iteration  is  very  simple  (even  for  nonlinear 
W  the  same  power  iteration  applies).  The  power  iteration  can  be  analyzed  if  W  is  known. 
Consider  the  representation  of  an  algorithm  by  the  iterations  on  IT,  in  which  the  vector  of 
amplitudes  is  normalized  at  each  iteration  (not  necessary  but  to  keep  the  norms  bounded): 

Fourier  Power  Iterations 

B°  =  B 

For  k  =  1,2. ...  do: 

1)  B’^  =  WB^-^ 

2) 

3)  U^  =  UB^ 

The  following  lemma  shows  towards  what  converge  the  Power  Iterations  and  the  algo¬ 
rithm,  and  shows  the  relative  convergence  rates. 

Lemma  1  In  the  Fourier  Power  Iterations  algorithm,  if  Ei  is  the  dominant  eigenvector 
of  W  and  if  B°  is  not  defective  in  Ei  then: 

1)  B^  converges  to  Ei, 

2)  U^  converges  to  UE\. 

3)  If  B^  is  not  defective  in  the  first  eigenvectors  amplifying  Ui  and  Uj  then: 

^ij,B^  ^  (2-6) 

Proof  1)  is  obvious  since  Ei  is  the  dominant  eigenvector  of  IT.  Thus  2)  holds.  Let 
B°  =  Em=i  amEm  with  Gi  ^  0.  Then  B^  -  Em=i  Assume  that  Et  and  Ei 

are  the  first  eigenvectors  amplifying  Ui  respectively  Uj.  The  at  and  ai  are  nonzero  by  the 
hypothesis  3).  Then  for  sufficiently  large  k  the  denominator  is  not  0  and 
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In  typical  situations,  e.g.,  in  eigenvalue  algorithms,  it  is  desired  that  converges  to 
Ui-  Different  convergence  rates  can  be  defined  using  W,  its  eigenvalues  and  eigenvectors, 
and  the  separation  factors.  Define  the  asymptotic  convergence  rate  of  towards  Ui  by 

Cl  =  suplimk-^oo  max  |l/si,gfc|  (2-7) 

go  j=2...n 

where  the  in  the  sup  is  not  defective  in  any  of  the  eigenvectors. 

The  following  corollary  is  obtained  directly: 

Corollary  In  the  Fourier  Power  Iterations  converges  to  Ui,  for  any  nondefective 
in  El,  if  and  only  if  Ei  =  (1,0,...,  0)^.  In  case  of  convergence,  the  asymptotic  convergence 
rate  is  Ci  =  |/,<2|/|Mi|- 

OBSERVATIONS 

The  following  two  examples,  when  the  convergence  rate  can  be  very  good,  motivate  the 
above  discussion: 

1)  The  inverse  power  algorithm  for  eigenvalue  problems: 

All  =  UA  (2.8) 

where  U  are  the  eigenvectors  of  A  associated  to  the  eigenvalues  of  A  =  diag(\i, ...,  A„).  The 
inverse  power  algorithm  iterates  the  operator  (A-$/)“^  starting  with  UB^  and  normalizes 
the  result  at  each  step,  for  $  Ai.  This  corresponds  to  a  Fourier  Power  Type  algorithm 
where  W  =  diag{l/{Xi  -  #)),  (since  {A  -  ^I)~^UB  =  UWB  =  UB),  and  with  another 
normalization  at  step  2)  (for  which  a  similar  result  can  be  shown).  The  eigenvectors  of  W 
are  Ei  =  Ui  and  the  eigenvalues  are  p,-  =  l/(Ai  -  $).  In  this  case  the  convergence  rate  is 
very  good:  |$  —  Ai|/|$  —  A2I  ~  0; 

2)  An  MG  Eigenvalue  Cycle,  where  one  may  expect  a  similarly  good  convergence  rate  since 
the  MG  cycle  can  be  viewed  as  an  approximation  to  the  inverse  power  iteration.  Such  an 
operator  will  be  analyzed  next,  for  a  Two  Level  Cycle  algorithm. 


3  Separation  Analysis  of  the  Two  Level  Cycle 
Algorithm 

This  section  derives  and  analyses  the  separation  operator  for  a  two  level  MG  cycle  algebraic 
algorithm.  The  cycle  has  the  following  useful  features: 

1)  The  algorithm  is  algebraic  and  has  no  relation  with  any  grid  representation,  neither  the 
problems  should  be  finer  or  coarser,  the  operators  and  transfers  are  general  matrices; 
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2)  The  algorithm  is  simultaneous  for  several  solutions,  leading  to  a  generalization  of  the 
separation  setting  from  previous  section; 

3)  The  simultaneous  algorithm  has  advantages  over  the  corresponding  sequential  algorithm, 
e.g.,  it  can  incorporate  on  any  level  simultaneous  separation  techniques; 

4)  The  form  of  the  algorithm  is  general  so  that  the  algorithm  and  its  analysis  can  be  used 
not  only  for  eigenvalue  problems  but  for  system  solvers  too. 

In  this  cycle  q  solutions  are  treated  simultaneously,  thus  the  amplitudes  matrix  B  has 
dimensions  n  x  q.  The  names  coarse  level  and  fine  level  are  used  only  to  distinguish  the 
two  levels  and  because  these  names  are  used  often  in  connection  with  MG  algorithms. 

3.1  The  Two  Level  Cycle  Algorithm 

Suppose  that  A,  U,  A  are  n  x  n  matrices,  and  that  A',  U',  A'  are  m  x  m  matrices  such 
that: 


AU  =  UA  (3.9) 

A'U'  =  U'A'  (3.10) 

where  f/,  U'  are  the  eigenvectors  of  A,  A!  respectively,  corresponding  to  the  diagonal 
matrices  of  eigenvalues  A  and  A'.  In  case  of  equal  eigenvalues,  the  eigenvectors  will  be 
chosen  to  be  linearly  independent.  Let  P  and  R  be  two  relaxation  polynomials  such  that; 


P{A)U  =  UP{A)  (3.11) 

R{A')U'  =  U'R{A')  (3.12) 

There  are  given  the  transfer  matrices  J  and  I  such  that: 

JU  =  U'G  (3.13) 

lU'  =  UP  (3.14) 


where  J  and  G  are  m  x  n  matrices  while  I  and  F  are  n  x  m  matrices. 

Assume  given  an  n  x  q  matrix,  B,  a  diagonal  q  x  q  matrix  and  an  n  x  q  matrix 
=  UB  of  initial  solutions. 

Consider  the  following  Two  Level  Cycle: 

Two  Level  Cycle  (f/^f/) 

Input  =  UB 

1)  Relax  =  P{A)U^ 

2)  Compute  the  residual:  S  =  —  AU^ 
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3)  Transfer  the  residual:  S'  =  JS 

4)  Transfer  the  solution:  U'^  =  JV^ 

5)  Compute  the  FAS  right  hand  side:  T'  =  'R{A')U'^  +  JS 

6)  Solve  (or  Relax)  the  coarse  level  equation:  R{A')U'^  =  T' 

7)  FAS  -  Correct  the  fine  level  solution:  —  JU^) 

8)  Relax:  U  =  P{A)U^ 

Output  U 

OBSERVATIONS 

1)  The  step  6)  can  be  considered  as  a  relaxation:  =  R{A')~^T' 

2)  The  algorithm  can  be  continued  on  other  levels  in  the  same  way. 

3)  A  projection  can  be  introduced  at  certain  steps,  multiplying  the  solution  hy  a.  q  x  q 
matrix  E.  Since  E  depends  on  the  solutions,  the  algorithm  would  become  nonlinear  in  B, 
making  the  next  analysis  more  difficult. 

4)  Different  relaxations  can  be  used  at  steps  1)  and  8). 

5)  The  FAS  (Full  Approximation  Scheme)  transfers  at  steps  5)  and  7)  follow  the  scheme: 
the  problem  E'{U')  =  T'  is  an  FAS  transfer  of  the  problem  E{U)  =  T  A  T'  =  E'{JU)  + 
J{T  —  E{U));  and  the  corresponding  FAS  correction  reads  U  —  U  +  I{U'  —  </D),  see  [2]. 

3.2  The  Two  Level  Cycle  Separation  Operator 

This  subsection  computes  the  separation  operator  W  for  the  algebraic  Two  Level  Cycle. 
The  two  level  algorithm  transforms  the  initial  solution  =  UB  into  the  final  solution 
U  =  UB.  Since  the  columns  of  U  are  independent,  the  B  is  uniquely  determined  for  the 
given  U,  allowing  to  define  as  in  previous  section 
The  Two  Level  Cycle  Operator  W  by: 

WB  =  B  (3.15) 

Denote  by  /„  the  n  x  n  identity  matrix.  Assume  that  R{A')  is  invertible  and  denote  its 
inverse  by  R~^{A').  The  operator  W  can  be  computed  directly  from  the  above  algorithm 
and  from  (3;11-3.14)  and  is  given  by: 

Theorem 

1 )  The  Two  Level  Cycle  Separation  Operator  W  is  defined  by: 

WB  =  P(A)(  P{A)B  +  ER-\A')G{P{A)B^  -  AP{A)B)  )  (3.16) 

2)  If  q  —  1  then 

W  =  P(AX  h  +  PR-\A')G{^In  -  A)  )P(A)  (3.17) 
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Proof  Since  =  UB,  the  relations  (3.11-3.14)  imply; 

=  P{A)U^  =  P{A)UB  =  UP{K)B  (3.18) 

,S  =  UH  -  AU^  =  U{P{A)B^  -  AP{A)B)  =  UX  (3.19) 

where 

X  =  P{A)B^  -  AP{A)B  (3.20) 

The  transfers  give:, 

C/'i  =  ^  JUP{A)B  =  U’GP{A)B  (3.21) 

JS  =  JUX^U'GX  (3.22) 

and  solving  the  coarse  level  equation: 

R{A)U'^  =  R{A')U'^  A  JS  (3.23) 

=  U'^  +  R-\A')JS  =  JU^  -f  R-\A!)JS  =  JU^  +  U'R-\A')GX  (3.24) 

Then  the  FAS  -  Correction  reads: 

f/3  =  AI{U'^  -  JU^)^U^  AIU'R-\A')GX  (3.25) 

=  U{P{A)B  +  FR-\A')GX)  (3.26) 

and  the  final  relaxation  implies: 

U  =  P{A)U^  =  UP{A){P{A)B  +  FR-\A')GX)  =  UB  (3.27) 

Hence: 

B  =  P(A)(P(A)H  +  FR-\A')GX)  (3.28) 

Substituting  X,  the  point  1)  of  the  theorem  is  obtained: 

WB  =  B  =  P(A)(  P(A)P  +  FR-\A')G{P{A)B^  -  AP(A)P)  )  (3.29) 

For  the  case  g  =  1,  $  is  a  scalar  and  commutes  with  P{A)B  thus  point  2)  results. 
Iterating  the  Two  Level  Cycle  the  following  algorithm  is  obtained: 

Two  Level  Iterations 
Input  pi  =  UB,  $ 
for  k  =  1,2, ...  do: 

1)  Two  Level  Cycle  (P^,P^'*'i) 


7 


2)  Normalize  the  columns  of  Uk+i 


OBSERVATIONS 

1)  For  the  Two  Level  Iterations  algorithm  holds  a  Fourier  Power  Iterations  algorithm  as 
described  in  section  (2). 

2)  As  in  the  Corollary  of  Lemma  1,  for  g  =  1,  the  convergence  criteria  is  obtained: 

Lemma  2  In  the  Two  Level  Iterations,  converges  to  Ui,  for  any  initial  nondefec¬ 
tive  in  Ui,  if  and  only  ifW  has  the  dominant  eigenvector  (1,0,  The  single  difference 

consists  in  the  normalization  of  by  =  B^  jc^  where  is  a  constant  for  normalizing 
the  solutions. 

3)  Denoting  B  —  {bi, ...,  the  k  component  of  the  vector  WB  is: 

n  m 

(WB),  =  P\At)h  +  P(A,)  E  E(ni'R-'{A')G.,)($  -  A,)P(Ai)bj  (3.30) 

j  =  l  2  =  1 

This  formula  will  be  used  in  the  following  sections. 

3.3  Separation  Factors  in  case  of  Mixing 

In  this  paragraph  the  separation  factors  are  analyzed  in  a  case  when  the  first  two  vectors 
of  U  are  mixed  by  W  during  the  transfers,  but  are  not  mixed  with  other  vectors,  i.e.,  the  F 
and  G  have  the  structures  from  (3.31,  3.32).  It  will  be  shown  that  the  mixing  damages  the 
separation,  nevertheless  the  algorithm  may  be  efficient  for  proper  choices  of  relaxations. 
Assume  that  q  —  I,  B  —  {b\,  62, 0,  ...0)^  and: 

(  1  Gi2  0...0 

G2\  1  0...0 

G  =  0  0 

* 

V  0  0 

(  1  Ei2  0...0 
F21  1  0...0 

E  =  0  0  I  (3.32) 


0  0 


The  first  two  components  of  WB  will  be: 


{\¥B)y  =  P"(Ai)6i  +  P(Ai)((/?-'(A;)  +  Fi2i?-'(A^)G2i)($-Ai)P(Ai)6:  + 

+(i2-'(A;)G'i2  +  Fi2i?''(A' ))($  -  k2)P{^2)b2  (3.33) 

{WB)2  =  P\h2)h2¥  P{^2){{F2iR-\^\)¥  R-\^'2)G2l){^  -  ^l)P{h-x)hl  + 

+(F2ii?-'(A;)Gi2  +  i?“'(A;))($  -  ^2)P{^2)b2  (3..34) 

Assume  that  the  Richardson  relaxation  is  used  for  A: 

P(A)  = /  +  a;(A-$)  (3.35) 


such  that 

R(Afc)  =  l+a.’(Afc-$)^l  (3.36) 

and  the  inverse  power  iteration  is  used  for  A': 

R{A')  =  A'-^,  R(Afc)  =  A'fc-#  (3.37) 

To  simplify  the  analysis  it  is  assumed  that: 

#  Ai  (3.38) 

P{Ai)  «  1  (3.-39) 

($-A2)/(A' -$)Ri-l  (3.40) 

A'l  Ai  (3.41) 

The  next  approximation  is  obtained  for  the  first  two  components  (the  rest  of  the  matrix  is 
not  relevant  and  ignored  further): 


WB 


1  7  -  Fi2 
0  7T21 


(3.42) 


Where 

7  =  G'i2(f  -  A2)/(A;  -  $)  (3.43) 

If  Gi2  is  not  zero  then  7  may  be  large  since  A^  —  $  is  small.  The  two  eigenvalues  of 
the  above  W  are  //i  =  1  and  /<2  =  7j^2i  corresponding  to  the  eigenvectors  Ei  =  (1,0)^ 
and  E2  =  ((-7  +  Fi2)/{1  -  1F21),  If.  If  1  >  \fi2\  then  iterating  the  two  level  cycle,  the 
solutions  UB^  will  converge  to  Ui,  by  Lemma  2.  If  1  <  |/i2|  then  the  iterations  will  converge 
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to  {Ui,  U2)E2.  In  the  case  1  <  l^al,  the  separation  can  be  improved  by: 

1)  improving  the  relaxation  or  the  transfers  (e.g.,  preconditioning  the  transfers  or  using 
higher  order  transfers),  these  leading  to  1  >  |^2|j 

2)  treating  simultaneously  the  vectors  Ui  and  U2  and  separating  them  by  a  Rayleigh-Ritz 
type  projection  as  shown  for  example  in  [5]  [8]  and  analyzed  in  [10]. 

The  asymptotic  convergence  rate  in  the  case  1  >  I//2I  is 

\H2/fJ-i\  =  1/^2]  <  1  (3-44) 

which  can  be  good,  e.g.,  if  G'i2T’2i  is  small,  but  can  be  close  to  1  if  7  is  large.  Nevertheless 
the  convergence  in  the  first  few  cycles  may  be  very  good  as  shown  by  the  relative  separation 
factor.  If  at  the  beginning  fei  =  62  =  1  and  7  is  large,  then  si2,b  =  (1  +  7  “  ^i2)/(7^2i)  ~ 
I/F21.  In  this  case  the  separation  factor  of  Ui  relative  to  U2  is  approximately  I/F21  which 
may  be  very  good.  A  better  separation  is  obtained  if  G'12  ~  0,  when  7  0  thus  the 

separation  factor  is  (1  -  Fi2)l{'yFi2)  ^  00.  In  the  latter  case,  when  low  mixing  appears 
due  to  G'i2,  the  cycle  separates  well  the  first  eigenvector  from  the  second  one  in  the  first 
iteration.  An  important  observation  is  that  in  this  case  the  role  of  the  relaxation  by  P  is 
negligible,  the  good  separation  being  due  mainly  to  the  good  transfer  G12  ~  0  and  to  the 
good  approximation  of  the  eigenvalue  Ai  #. 

3.4  Separation  Factors  for  Decoupled  Components 

To  show  the  good  efficiency  of  the  MG  cycle  in  the  case  when  the  eigenvectors  are  not 
mixed  during  the  transfers,  the  previous  example  in  which  the  mixing  coefficients  are  0  is 
considered: 

Gx2  =  G21  =  Fu  =  T21  =  0  (3.45) 

A  more  accurate  estimate  of  the  relative  separation  factor  for  bi  =  82  =  I  and  by  (3.33,3.34) 
is: 

[1  +  (4,  _  a,)/(a;  -  <t)|/|l  +  ($  -  A2)/(A'  -  «)|  =  I 

which  is  large  in  the  following  assumptions  which  are  met  especially  in  MG  algorithms 
where  $  is  obtained  from  coarser  levels  by  an  FMG  algorithm  [2]  [5]  [6]: 

A2  -  A2  »  0 

(A;-Ax)/(Ai-$);:^l 

|A'  -  $1  >  0 
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(3.47) 

(3.48) 

(3.49) 


OBSERVATION 

The  efficiency  of  the  two  level  cycle  may  be  very  good  also  in  case  of  close  eigenvalues, 
when  #  approximates  well  the  eigenvalue  Ai  and  when  the  two  levels  have  close  eigenvalues 
K2  ^  A.2.  This  is  an  explanation  of  the  highly  accurate  separation  obtained  in  numerical 
tests  for  problems  presenting  very  close  eigenvalues  [4]  [5]  [6]  [8].  The  good  separation 
obtained  by  the  MG  cycle  may  also  explain  why  projections  were  not  required  on  fine 
levels  even  for  clusters  of  very  close  eigenvalues  [4]  [5]  [6]  [8]. 


4  Example  of  Fourier  Analysis  of  the  Two  Level 
Separation  Operator 

In  some  cases,  especially  for  discretizations  of  partial  differential  equations  on  regular  grids, 
the  two  level  separation  operator  can  be  computed  and  analyzed  using  for  U  Fourier  compo¬ 
nents,  as  shown  in  the  next  example.  This  provides  insight  for  the  design  of  the  algorithms 
and  to  the  prediction  of  the  algorithms  performance. 


4.1  The  Two  Level  Separation  Operator 

The  two  level  separation  operator  W  for  the  algebraic  two  level  cycle,  in  the  common 
assumption  n  =  2m,  is  presented  next.  For  n  =  2m  the  matrices  F  and  G  have  the  forms 
F  =  (^1,^2)^,  G  =  (G'i,G2),  with  m  X  m  matrices  Fi,  Fj,  Gi,  G'2.  Further,  Id  will 
denote  the  identity  matrix.  It  is  assumed  q  =  1,  so  W  has  the  form  (3.17).  Denote 


A  = 


Ai  0  \ 
0  A2  j 


(4.50) 


where  Ai,  A2  are  m  x  m  diagonal  matrices.  In  this  case  (3.17)  provides: 


(  Wn  Wn  \ 
\  W21  W22  ) 


(4,51) 


with 


Wn  =  F(Ai)(7d  +  FiF-'(A')Gi($/d-Aa))F(Ai)  (4.52) 

IT22  =  P{A2){Id  +  F2R-\A')G2i^Id-A2))P{A2)  (4.53) 

W12  =  F(Ai)FaF-'(A')G'2($/d-A2))F(A2)  (4.54) 

W21  =  F(A2)F2F-^(A')Gi($/d- Ai))F(Ai)  (4.55) 
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4.2  The  Two  Level  Separation  Operator  for  the  Schrodinger 
Eigenvalue  Problem 

The  two  level  separation  operator  for  the  Schrodinger  Eigenvalue  Problem  in  1-D,  with 
periodic  boundary  conditions,  is  derived  further.  For  2-D  and  3-D  similar  derivations  hold. 
The  problem  is: 

AC/ =  C/A  (4.56) 


on  the  interval  [0,27r].  The  operators  A  and  A'  are  the  discretizations  of  the  Laplacian, 
with  the  stencil  (1—2  1  on  two  grids  with  2m  (respective  m)  equally  spaced  points. 
The  complex  eigenvectors  and  the  corresponding  eigenvalues  are  considered: 


c/fc(0  = 

= 


exp{i2Tklf2m)^ 
exp{i2'Kkj  Im)^ 


\k  =  -^(1  -  cos(27rA:/2m)), 
^  ~  cos(27rC:/m)), 


A;  =  0,  ...,2m-  1  (4.57) 
k  —  0,  ...,m  —  1  (4.58) 


The  eigenvalues  are  negative,  ranging  from  Aq  =  0  to  the  size  of  A  m  where 

h  =  27r/(2m.)  is  the  fine  mesh  size.  The  eigenvalues  satisfy 


=  A 


m-{-k  7 


Ac.  —  A 


2m— k  •) 


A:  =  0, ...,  m  —  1 


(4.59) 


The  real  and  imaginary  parts  of  the  complex  eigenvectors  are  the  real  eigenvectors: 

Ul{l)  =  cos{i27rkll2m),  A:  =  0, ...,  2m  —  1  (4.60) 

IJI{1)  —  sin{i2‘Kkll2rn)^  A;  =  1, ...,  2m  —  1,  k^m  (4-61) 

where  U^^-k  =  and  C/^„_fc  =  -C/^-  The  analysis  can  be  done  for  the  real  eigenvectors 
but  it  is  more  convenient  computationally  to  use  the  complex  ones.  The  real  eigenvectors 
can  be  used  in  programs  which  build  W  and  analyse  the  separation. 

The  transfer  J  is  the  full  weighting  operator  with  stencil  (12  1  )/4.  /  is  the  linear 
interpolation  operator.  Then  the  matrices  Fi,  F21  C?i,  G2  are  diagonal  and  all  elements  of 


F  and  G  are  zero  except  for  A;  =  0, ...,  m  —  1: 

Gkk  =  (1  +  cos(7rA;/m))/2  (4.62) 

GkMm  =  (1  -  cos(7rA:/m))/2  (4.63) 

Fkk  -  (1  +  cos(7rA;/m))/2  (4.64) 

FkArm,k  =  (1  -  cos(7rA:/m))/2  (4.65) 

since  the  transfers  imply  for  A:  =  0, ...,  m  —  1,  i  =  0, ...,  m  —  1: 

{Uk{2j  -1)  +  2Uk{2j)  +  Uki2j  -b  l))/4  =  U'k{j){l  +  cos(7rA:/m))/2  (4.66) 


12. 


-  1)  +  +  Uk+mi‘^j  +  l))/4  =  Ul{j){l  ~  cos{jrfc/m))/2  (4.67) 


Ut(2j)  =  U'kU)  '  (4.68) 

t/t(2j  +  l)  =  ((/^(j)  +  C7;(;  +  l))/2  (4.69) 

thus 

JUk  =  U'l^Gkki  k  =  0,...,m  —  1  (4-70) 

JUk+m  =  UkGk,k+m,  k  =  0,...,m~l  (4.71) 

lU'j.  =  FkkUk  +  Fk^m,kUk+m-,  ^  =  — 1  (4-72) 

Then  the  elements  of  the  operator  W  become: 

ITn  =  diag{P{\k){l  +  FkkR-\yk)Gkk{^  -  \k))P{h))  (4.73) 

1'F22  =  diag(P{Xk+m)i^  +  Fk+m,kR  ^{^'k)Gk,k+in{^  —  Xk+m))P{Xk+m))  (4-74) 

ITi2  =  diag{P{Xk)FkkR~^WGk,k+m{^  -  Xk+m)P{Xk+m))  (4.75) 

W21  =  dtag{P{Xk+m)Fk+m,kR-\X[)Gk,k{^  -  Xk)PiXk))  (4.76) 


4.3  Analysis  and  Optimization  of  the  Two  Level  Cycle 

The  W  operator  (4.73-4.76)  is  used  to  analyse  and  optimize  the  two  level  cycle  algorithm. 
R  is  taken  the  shifted  inverse  power  operator 


(4.77) 

The  relaxation  operator  is 

taken 

P{A)  =  Id  +  u{A-^) 

(4.78) 

then 

P[Xk)  —  1  +  —  $) 

(4.79) 

Assume  that 

to  —  —  cxh  /4 

(4.80) 

where  a  will  be  chosen  in  a  convenient  way.  To  analyze  the  relaxation  note  that  the 
asymptotic  separation  factor  of  Ui  relative  to  Uj  and  to  the  relaxation  is 


Sij 


—  1  +  <^{Xi  —  A) I  _  IjAm^l  +  a{Xi  —  A)1 


il -f- c<;(Aj  —  A)|  ||A„ 

a{Xj  -  Xi) 


+  ~  '^)l 


|1 


[ATTiail  "h  Q((Aj  A) 


(4.81) 

(4.82) 
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It  follows  that  if  Ai  «  Xj  then  Sij  ^  1  thus  the  relaxation  will  be  very  slow  in  separating 
Ui  from  Uj.  If  Xi  is  close  to  Ai  and  Xj  is  close  to  Xmax  then  Sij  ~  |1  "h  Thus  the 

relaxation  is  more  efficient  in  separating  far  clusters.  Within  clusters  another  separation 
technique,  like  a  Generalized  Rayleigh  Ritz  projection,  or  MG  projections,  or  an  MG  cycle  is 
required,  see  for  example  [5]  [8]  [10].  An  essential  property  of  the  relaxation  is  the  damping 
of  errors  coming  from  eigenvectors  which  are  not  well  represented  on  coarser  levels.  This 
is  called  the  smoothing  property  of  the  relaxation.  If  Ui  is  a  smooth  vector  and  Uj  is  a 
component  of  the  error,  then  Uj  is  damped  by  each  relaxation  with  the  separation  factor 

Sij^ 

Next  computation  finds  an  a  such  that  the  separation  factors  sot  >  /?  >  1  for  all 
nonsmooth  components  Uk-,  assumed  A  =  Aq  =  0.  Recall  from  (4.57)  that  the  nonsmooth 
components  Uk  have  the  frequencies  7r/2  <  6  =  Trklm  <  37r/2  corresponding  to  m/2  < 
k  <  3m/2  and  to  lAmail  =  l^ml  =  4//*^.  Then 

|sofc|  =  |2/(2  -  «(1  -  cos{irklm))\  (4.83) 

The  extreme  values  of  |so/t|  are  obtained  for  ‘I'l^kj'lm  =  0  —  7r/2  and  tt,  thus  k  m/2 
respective  m,  for  which  |5om/2|  =  [2/(2  —  Q:)l  and  |som|  =  |1/(1  “  «)!•  Both  7r/2  and  tt 
components  can  be  separated  by  relaxation  from  Uq  with  the  factor  |5om/2|  —  I’^oml  =  3  if 

Q  =  4/3  (4.84) 

Moreover,  one  ralaxation  will  damp  all  high  frequency  components  by  a  factor  larger  than 
1/3.  If  a  multilevel  cycle  damps  well  the  smooth  components  of  the  errors,  on  coarse  lev¬ 
els  where  these  components  can  be  well  represented,  and  does  not  amplify  the  oscillatory 
components,  then  the  cycle  should  have  a  separation  factor  of  (l/.3)^,  for  p  relaxations  per¬ 
formed  on  the  fine  level.  This  factor  may  not  be  obtained  in  case  of  mixing  of  eigenvectors, 
and  in  the  case  when  not  all  smooth  components  are  damped  well,  e.g.,  the  frequencies 
close  to  the  frequencies  of  the  desired  eigenvectors,  are  damped  slowly  by  the  relaxation. 


OBSERVATIONS 

1)  The  WB  is 


WB  =  W 


By 

B2 


WnBy  Wy2B2  \  \  ^ 

IT21R1  W22B2  )  \B2  I 


(4.85) 


Thus  if  W21  is  not  small  enough  then  the  large  coefficients  of  the  smooth  components.  By, 
of  order  1,  will  imply  large  coefficients  B2  of  the  nonsmooth  errors.  The  factors  of  W21 
which  can  be  improved  in  (4.76)  are 


PiXk+  m  m,k 


(4.86) 


14 


This  can  be  done  by  changing  the  value  of  a,  say  close  to  2,  to  damp  more  efficiently  the 
frequencies  close  to  •r/2, 37r/2,  which  are  multiplied  with  1/2  by  transfers. 

2)  The  relaxation  can  be  improved  also  using  a  combination  of  relaxations  with  different 
values  of  a  which  will  damp  different  frequencies. 

3)  Changing  the  relaxation  with  one  having  better  smoothing  properties,  of  GS  type, 
showed  large  improvements  in  computer  experiments. 

4)  Preconditioning  of  the  transfers  can  be  used  to  reduce  the  amplitudes  of  the  oscillatory 
components.  For  example  smoothing  can  be  introduced  before  the  transfer,  say  using  a  sten¬ 
cil  (  1  2  1  )/4  which  multiplies  the  Fourier  components  with  the  factor  (1  -f-  cos{7rk/m))/2. 

5)  Higher  order  interpolations  can  be  used  to  reduce  the  Gk,k+m  terms. 

6)  The  algorithm  can  be  optimized  using  a  subroutine  which  computes  the  matrix  W,  for 
different  parameters  such  as  A,  o,  number  of  relaxation,  coarse  level  relaxation  type.  An 
optimization  search  for  parameter  combinations  providing  an  efficient  multilevel  cycle  can 
be  easily  performed  having  such  a  subroutine.  An  observation  which  reduces  much  the 
analysis  of  W  is  that  W  has  the  desired  eigenvector  (1,0,  ....0)^  iff  its  first  column  is  a 
multiple  of  this  vector.  An  optimization  approach  can  be  directed  towards  the  treatment 
of  the  first  column. 

7)  An  analysis  similar  with  the  one  performed  for  the  first  vector  can  be  performed  for 
the  first  cluster.  The  elements  below  the  block  corresponding  to  this  cluster  should  be  0  to 
avoid  mixing  with  other  clusters.  The  block  corresponding  to  the  cluster  may  have  nonzero 
subdiagonal  elements.  This  suggests  that  a  separation  inside  the  cluster  is  required.  This 
separation  can  be  performed  on  coarse  or  on  fine  levels. 

8)  The  analysis  of  W  can  show  what  clusters  have  to  be  completed  and  which  components 
have  to  be  treated  simultaneously.  This  is  important  for  robustness  and  efficiency.  It  is 
simple  to  observe  that  the  algorithm  can  be  very  efficient  in  converging  to  a  complete  clus¬ 
ter,  treated  simultaneously,  while  it  will  fail  if  it  will  treat  only  one  of  the  components.  A 
comparison  between  a  simultaneous  and  a  sequential  algorithm  can  be  performed  using  W. 

9)  If  a  cluster  mixes  with  a  second  cluster  it  is  an  indication  to  include  the  second  cluster 
in  computation  and  to  treat  it  simultaneously  with  the  first  one. 

10)  A  complete  cluster,  which  does  not  mix  with  another  cluster  is  a  good  basis  for  a  stable 
subspace  technique. 

11)  Divergence  of  some  components  does  not  imply  that  the  algorithm  is  not  efficient.  Sep¬ 
aration  is  important.  For  example,  for  finding  the  second  cluster  one  may  have  to  use  in 
computations  the  first  cluster  too.  The  first  cluster  may  diverge  but  if  the  two  clusters  get 
well  separated  from  the  remaining  components,  then  an  algorithm  treating  both  clusters 
simultaneously  should  be  efficient. 
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12)  Divergence  can  be  treated  using  different  relaxations,  e.g.,  which  amplify  most  speci¬ 
fied  components. 

13)  The  computation  of  W  and  the  optimization  of  the  algorithm  using  W  can  be  efficiently 
performed  on  coarse  levels.  The  computation  of  W  on  fine  levels  is  usualy  a  very  expensive 
task  but  generally  not  needed,  a  coarse  version  of  W  being  sufficient  for  optimization. 

14)  The  relative  separation  factors  may  be  important  in  an  FMG  algorithm,  and  not  as 
much  the  asymptotic  factors.  In  an  FMG  algorithm  for  computing  Ui,  the  amplitudes  B 
come  already  close  to  (1,0, ...,  0)  so  that  only  the  relative  separation  of  certain  components 
may  be  relevant,  usually  the  ones  which  mix  with  Ui- 

15)  The  separation  analysis  can  be  useful  also  for  cases  when  W  is  not  linear.  Two  such 
cases  are  when  a  projection  is  used  in  the  algorithm,  and  when  IT  is  a  composition  of 
separation  of  operators  some  of  which  can  be  analysed. 

16)  The  computation  of  W  can  be  performed  in  different  ways.  The  presented  way,  i.e., 
using  its  analytic  form,  may  not  be  the  best  one.  A  way  to  compute  easily  W  for  different 
changes  of  the  algorithm  is  required.  One  way  is  to  compute  directly  W  using  the  action 
of  the  algorithm  on  a  basis,  e.g.,  on  the  columns  of  U  or  on  the  columns  of  the  identity 
matrix.  Another  way  is  to  compute  IT  as  a  composition  of  simpler  mappings. 

17)  The  optimization  can  be  performed  by  an  MG  procedure.  This  is  an  optimization 
problem  with  several  local  minima  usually.  See  [11]  for  an  outline  and  application  of  an 
MG  optimization  approach  usable  for  several  local  minima. 

18)  The  optimization  of  the  algorithm  using  IT  leads  to  robust  algorithms.  The  asymptotic 
convergence  rates  can  be  accurately  predicted.  Worst  cases  can  be  found. 

The  behavior  predicted  by  IT  was  accurately  reproduced  by  a  program  implementing 
the  two  level  algorithm. 


References 

[1]  R.  E.  Bank;  Analysis  of  a  multi-level  inverse  iteration  procedure  for  eigenvalue  prob¬ 
lems:  SIAM  .J.  Numer.  Anal.,  19,  pp.  886-898,  1982 

[2]  A.  Brandt;  Multigrid  Techniques  1984  Guide  with  Applications  to  Fluid  Dynamics; 
GDM  Studien  Nr,  85.  Gesellschaft  fiir  Mathematik  und  Datenverarbeitung;  St.  Au¬ 
gustin,  1984 

[.3]  A.  Brandt,  S.  McCormick  and  J.  Ruge;  Multigrid  Methods  for  Differential  Eigenprob- 
lems;  SIAM.  J.  SCI.  STAT.  COMPUT.,  Vol  4,  No  2,  1983. 


16 


[4]  S.  Costiner,  F.  Manolache,  S.  Ta’asan;  Multigrid  Methods  Applied  to  the  Design  of 
Resonant  Cavities;  In  print  at  IEEE  -  MTT,  1995 

[5]  S.  Costiner,  S.  Ta’asan;  Adaptive  Multigrid  Techniques  for  Large  Scale  Eigenvalue 
Problems,  Solutions  of  the  Schrodinger  Problem  in  2D  and  3D;  submitted  to  Physical 
Review  E,  1994 

[6]  S.  Costiner,  S.  Ta’asan;  Simultaneous  Multigrid  Techniques  for  Nonlinear  Eigenvalue 
Problems,  Solutions  of  the  Nonlinear  Schrodinger  Poisson  Eigenvalue  Problem  in  2D 
and  3D;  submitted  to  Physical  Review  E,  1994 

[7]  S.  Costiner,  S.  Ta’asan;  Separation  Techniques  for  Multilevel  Eigenvalue  Solvers  Ap¬ 
plied  to  a  Nonlinear  Schrodinger  Eigenvalue  Problem;  Technical  Report  CS92-07,  The 
Weizmann  Institute  of  Science,  Rehovot,  Israel,  1992 

[8]  S.  Costiner,  S.  Ta’asan;  Multigrid  Techniques  for  Nonlinear  Eigenvalue  Problems; 
NASA  CR-194999,  ICASE  Report  94-91;  ICASE,  NASA  Langley  Research  Center, 
Hampton,  VA  23681,  USA,  1994 

[9]  S.  Costiner,  S.  Ta’asan;  A  Robust  Multilevel  Simultaneous  Eigenvalue  Solver;  NASA 
CR-191491,  ICASE  Report  93-35;  ICASE,  NASA  Langley  Research  Center,  Hampton, 
VA  23681,  USA,  1993 

[10]  S.  Costiner,  S.  Ta’asan;  The  Algebraic  Multigrid  Projection  for  Eigenvalue  Problems, 
Backrotations  and  Multigrid  Fixed  Points;  NASA  CR- 194990,  ICASE  Report  94-82; 
ICASE,  NASA  Langley  Research  Center,  Hampton,  VA  23681,  U  SA,  1994 

[11]  S.  Costiner,  M.  Kovalenko;  MGNN  -  A  Multigrid  Neural  Network  with  Application  to 
Image  Processing;  Proc.  of  the  10th  lAICVNN,  Israel  1993 

[12]  S.  Costiner;  PhD  Thesis;  The  Weizmann  Institute  of  Science,  Rehovot,  Israel,  1995 

[13]  K.  Davstad;  A  Multigrid  Conjugate  Residual  Method  for  the  Numerical  Solution  of  the 
Hartree-Fock  Equation  for  Diatomic  Molecules;  JCP,  Vol  99,  nrl,  pp  33-38,  1992 

[14]  G.  H.  Golub,  C.F.  Van  Loan;  Matrix  Computations;  The  Johns  Hopkins  University 
Press,  1989 

[15]  W.  Hackbush;  On  the  computation  of  approximate  eigenvalues  and  eigenfunctions  of 
elliptic  operators  by  means  of  a  multi-grid  method;  SIAM  J.  Numer.  Anal.,  16,  pp 
201-215,  1979 


17 


[16]  W.  Hackbusch;  Multigrid  methods  and  applications;  Springer  Series  in  Comp.  Math. 

4,  Springer- Verlag,  Berlin,  1985 

[17]  W.  Kerner;  Large-Scale  Complex  Eigenvalue  Problems,  Review  Article;  JCP.  85,  pp 
1-85,  1989 

[18]  J.  Mandel,  S.  McCormick;  A  Multilevel  Variational  Method  for  Au  =  XBu  on  Com¬ 
posite  Grids;  JCP  80,  pp  442-452,  1989 

[19]  F.  B.  Manolache,  S.  Costiner,  S.  Ta’asan,  D.  D.  Sandu;  Multigrid  Subspace  Techniques 
for  the  Computation  of  Close  Frequency  Eigenmodes  in  Complex-Shaped  Resonant 
Cavities;  Submitted  to  The  13th  Meeting  on  Hertzian  Optics  and  Dielectrics;  Zaragoza, 
Spain,  September,  6-8,  1995 

[20]  S.  F.  McCormick;  Multilevel  Projection  Methods  for  Partial  Differential  Equations; 
SIAM,  1992 

[21]  S.  F.  McCormick;  A  mesh  refinement  method  for  Ax  =  XBx;  Math.  Comp.,  36,  pp 
485-489,  1981 

[22]  P.J.  Nikolai;  ALGORITHM  538,  Eigenvectors  and  Eigenvalues  of  Real  Generalized 
Symmetric  Matrices  by  Simultaneous  Iteration;  ACM  Trans,  on  Math.  Software,  Vol 

5,  No  1,  pp  118-125,  1979 

[23]  B.  N.  Parlett;  The  Symmetric  Eigenvalue  Problem;  Prentice-Hall,  Englewood  Cliffs, 
NJ,  1980 

[24]  S.  Ta’asan;  Multigrid  Method  for  Stability  Calculations;  J.  of  Scientific  Computing, 
Vol.  3.  No.  3.  1988 

[25]  S.  Ta’asan,  S.  Costiner;  Multilevel  Techniques  for  Large  Scale  Eigenvalue  Problems 
Proc.  of  the  Lanczos  Centenary  Conference  1993,  North  Carolina  State  University, 
1994 

[26]  J.H.  Wilkinson;  The  Algebraic  Eigenvalue  Problem;  Clarendon  Press,  Oxford,  1965 

[27]  L.Y.  Zaslavsky;  An  Adaptive  Algebraic  Multigrid  for  Multigroup  Neutron  Diffusion 
Reactor  Core  Calculations;  Applied  Math,  and  Computation  53,  pp  13-26,  Elsevier, 
1993 


18 


REPORT  DOCUMENTATION  PAGE 


Form  Approved 
0MB  No.  0704-0188 


Public  reporting  burden  for  this  collection  of  information  is  estimated  to  average  1  hour  per  response,  including  the  time  for  reviewing  instructions,  searching  existing  data  sources, 
gathering  and  maintainingthe  data  needed,  and  completing  and  reviewing  the  collection  of  information.  Send  comments  regarding  this  burden  estimate  or  any  other  aspect  of  this 
collection  of  information,  including  suggestions  for  reducingthis  burden,  to  Washington  Headquarters  Services,  Directorate  for  Information  Operations  and  Reports.  1215  Jefferson 
Davis  Highway,  Suite  1204,  Arlington,  VA  22202-4302,  and  to  the  Office  of  Management  and  Budget,  Paperwork  Reduction  Project  (0704-0188),  Washington, ‘DC  20503. 

2.  REPORT  DATE  3.  REPORT  TYPE  AND  DATES  COVERED 

February  1995  Contractor  Report _ 


4.  TITLE  AND  SUBTITLE 

SEPARATION  ANALYSIS,  A  TOOL  FOR  ANALYZING 

MULTIGRID  ALGORITHMS 

5.  FUNDING  NUMBERS 

C  NASl-18605 

C  NASl-19480 

WU  505-90-52-01 

6.  AUTHOR(S) 

Sorin  Costiner 

Shlomo  Ta’asan 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Institute  for  Computer  Applications  in  Science 
and  Engineering 

Mail  Stop  132C,  NASA  Langley  Research  Center 

Hampton,  VA  23681-0001 

8.  PERFORMING  ORGANIZATION 
REPORT  NUMBER 

ICASE  Report  No.  95-8 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

National  Aeronautics  and  Space  Administration 

Langley  Research  Center 

Hampton,  VA  23681-0001 

10.  SPONSORING/MONITORING 

AGENCY  REPORT  NUMBER 

NASA  CR-195036 

ICASE  Report  No.  95-8 

11.  SUPPLEMENTARY  NOTES 

Langley  Technical  Monitor:  Dennis  M.  BushneU 

Final  Report 

To  be  submitted  to  the  Journal  of  Computational  Physics 

13.  ABSTRACT  (Maximum  200  words) 

The  separation  of  vectors  by  multigrid  (MG)  algorithms  is  applied  to  the  study  of  convergence  and  to  the  prediction 
of  the  performance  of  MG  algorithms.  The  separation  operator  for  a  two  level  cycle  algorithm  is  derived.  It  is  used 
to  analyze  the  efficiency  of  the  cycle  when  mixing  of  eigenvectors  occurs.  In  particular  cases  the  separation  analysis 
reduces  to  Fourier  type  analysis.  The  separation  operator  of  a  two  level  cycle  for  a  Schrodinger  eigenvalue  problem, 
is  derived  and  analyzed  in  a  Fourier  basis.  Separation  analysis  gives  information  on  how  to  chose  relaxations  and 
inter-level  transfers.  Separation  analysis  is  a  tool  for  analyzing  and  designing  algorithms,  and  for  optimizing  their 
performance. 


16.  PRICE  CODE 

_ A03 


NSN  7540-01-280-5500  Standard  Form  298(Rev.  2-89) 

Prescribed  by  ANSI  Std.  Z39-18 
298-102 


20.  LIMITATION 
OF  ABSTRACT 


15.  NUMBER  OF  PAGES 

20 


14.  SUBJECT  TERMS 

multigrid;  multilevel;  eigenvalue;  eigenvector;  separation;  Fourier  analysis 


18.  SECURITY  CLASSIFICATION  19.  SECURITY  CLASSIFICATION 
OF  THIS  PAGE  OF  ABSTRACT 

Unclassified 


17.  SECURITY  CLASSIFICATION 
OF  REPORT 

Unclassified 


12a.  DISTRIBUTION/AVAILABILITY  STATEMENT 

U  nclassified-U  nlimited 

Subject  Category  64 


12b.  DISTRIBUTION  CODE 


1.  AGENCY  USE  ONLYfteav^e  blank) 


